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(54) Processing of digital picture data in a decoder 



(57) A decoder for a digital audiovisual transmission 
system, the decoder comprising a processor means for 
decompressing and displaying compressed digital pic- 
ture data and a memory means 66, 67 characterised in 
that the memory means 66, 67 comprises a storage 
memory 66 allocated to receive decompressed digital 



image data from the processor means and at least one 
display memory 67 readable by the processor means 
prior to display, data being copied from the storage 
memory 66 to the display memory 67 for subsequent 
display. 
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Description 

[0001] The present invention relates to a decoder for 
a digital audiovisual transmission system, the decoder 
comprising a processor means for decompressing and 
displaying compressed digital picture data and a mem- 
ory means. 

[0002] Broadcast transmission of digital data is well- 
known in the field of pay TV systems, where scrambled 
audiovisual information is sent, usually by a satellite or 
satellite/cable link, to a number of subscribers, each 
subscriber possessing a decoder capable of descram- 
bling the transmitted program for subsequent viewing. 
Terrestrial digital broadcast systems are also known. 
Recent systems have used the broadcast link to trans- 
mit other data, in addition to or as well as audiovisual 
data, such as computer programs or interactive applica- 
tions. 

[0003] In the most basic level of functionality of such 
systems, digital audio and video data relating to the tel- 
evised programls transmitted in a compressed format 
for example, in accordance with the MPEG-2 compres- 
sion standard. The decoder receives and decom- 
presses this data in order to regenerate the televised 
program. 

[0004] In addition to simple televised program data, it 
is becoming increasingly common for the decoder to be 
required to handle other compressed image or graphic 
data. For example, in the case where the decoder 
includes web browser capabilities, the processor of the 
decoder may be required to receive and decompress 
downloaded digital picture data, for example, still video 
pictures, graphic icons, moving computer generated 
images etc. This picture information may be displayed 
over the normal televised program images. 
[0005] Such still or moving picture data may be typi- 
cally received in one of any number of compressed for- 
mats that are currently used in the context of PC based 
web browsers. For example, a picture may be formatted 
and compressed according to the well-known GIF or 
PNG standards, where an image is described by a col- 
our look-up table defining a table of colours and a matrix 
of pixel values referring to this table, the matrix data 
being compressed according to a known compression 
procedure to prepare the GIF/PNG picture. Alterna- 
tively, the picture may be formatted and compressed as 
a still MPEG or JPEG image, in which each pixel is 
directly associated with a red/green/blue colour value. 
[0006] It is an object of the present invention to pro- 
vide a means of efficiently handling such downloaded 
picture files. 

[0007] According to the present invention, there is pro- 
vided a decoder for a digital audiovisual transmission 
system, the decoder comprising a processor means for 
decompressing and displaying compressed digital pic- 
ture data and a memory means, characterised in that 
the memory means comprises a storage memory allo- 
cated to receive decompressed digital image data from 



the processor means and at least one display memory 
readable by the processor means prior to display, data 
being copied from the storage memory to the display 
memory for subsequent display. 

5 [0008] This division of the memory means into a stor- 
age and display memory areas introduces a degree of 
flexibility into the display of image data, in particular by 
permitting image data to be held contemporaneously in 
the storage and display means. 

10 [0009] In some instances, decompressed image data 
may simply be copied "as is" into the display memory. 
However, in some cases, the digital image data copied 
from the storage memory into the display memory is 
modified or duplicated during the copying step, for 

15 example, in order to resize the digital image or to copy 
the same image a number of times into the display 
memory. 

[0010] Preferably, the processor means is adapted to 
process image data in the display memory as one layer 
20 amongst a plurality of layers superimposed one over the 
other when displayed. 

[0011] As discussed above, picture data may be 
superimposed in a higher layer over, for example, audi- 
ovisual information representing normal televised 

25 images. However, in one embodiment the image data 
irrthe display memory may be displayed in a layer nor- 
mally used by the processor means to display broadcast 
audiovisual information. This may be the case, for 
example, where the decoder switches from a "televi- 

30 sion" mode, in which a broadcast emission is displayed, 
to a "web browser" mode, in which downloaded picture 
data from the internet is displayed in place of normal tel- 
evised programmes. 

[0012] Advantageously, the memory means com- 
35 prises a second display memory readable by the 
graphic processor means and corresponding to a sec- 
ond layer of displayed image data, data being copied 
from the storage memory to the second display memory 
for subsequent display in the second layer of image 
40 data. 

[001 3] Again, as before, the digital image data copied 
from the storage memory to the second display memory 
may be modified during the copying step. 
[0014] In one embodiment, for example, where the 

45 decoder switches between a television and browser 
mode, the image data in the second display memory 
may be displayed in the lowermost background layer 
normally used by the processor means to display broad- 
cast still audiovisual information. 

so [001 5] Preferably, partial image data is copied from 
the storage memory to a display memory under the con- 
trol of an application running within the decoder so as to 
permit display of part of an image. This may be desira- 
ble, for example, where the decompression and down- 

55 loading of an image into the storage memory by the 
processor proceeds in a number of stages. 
[001 6] In one embodiment, image data is copied from 
the storage memory into a first or second display mem- 
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ory under control of a high level application running on 
the processor means. Alternatively, this process may be 
handled automatically by a lower level application asso- 
ciated for example with the general handling of received 
image data. 

[001 7] Compressed digital picture data is preferably 
stored in a buffer memory means prior to decompres- 
sion by the processor means. It is not necessary that 
this buffer means be a single integral block of memory 
particularly if the data arrives in a number of blocks of 
information. In particular, in one embodiment, the buffer 
means comprises a plurality of buffer memory ele- 
ments. Each memory element may correspond, for 
example to a block of data downloaded in the decoder. 
[0018] Preferably, the decompression and transfer of 
image data from the buffer memory elements to the 
storage memory, and from the storage memory to a dis- 
play memory, is controlled by the processor means such 
that image information present in the storage memory is 
transferred to the display memory at the end of the 
decompression of the contents of each buffer element. 
[0019] It may be the case, for example, that informa- 
tion corresponding to one image will be spread over a 
number of buffer elements. As each buffer is emptied 
and decompressed, the information ready for display is 
transferred immediately to the display memory, enabling 
a partial display of the complete image. 
[0020] In addition, or alternatively, the decompression 
and transfer of a group of images in a single image file 
from the buffer memory means to the storage memory, 
and from the storage memory to a display memory, is 
controlled by the processor means such that image 
information is transferred from the storage memory to 
the display memory at the end of the decompression of 
each image in the image file.. 

[0021] As discussed above, image data may be sent 
in any number of formats. In one embodiment, the proc- 
essor is adapted to decompress picture data sent in a 
compression standard, such as GIF or PNG, that uses 
a colour look-up table. 

[0022] In addition or alternatively, the processor is 
adapted to decompress picture data sent in a compres- 
sion standard, such MPEG or JPEG, that uses a 
red/blue/green colour value associated with each pixel. 
[0023] The processor means in the decoder need not 
necessarily be embodied in a single chip but may be 
divided, for example, into a processor for decompres- 
sion and a graphic processor for preparing the decom- 
pressed data for display. 

[0024] The present invention has been discussed 
above in relation to a decoder apparatus. The present 
invention equally extends to a method of digital image 
processing within a decoder, and corresponding to the 
general and preferred aspects of the invention dis- 
cussed above. 

[0025] In the context of the present application the 
term ((digital audiovisual transmission system)) refers 
to all transmission systems for transmitting or broad- 



casting primarily audiovisual or multimedia digital data. 
Whilst the present invention is particularly applicable to 
a broadcast digital television system, the present inven- 
tion may equally be used in filtering data sent by'a fixed 
5 telecommunications network for multimedia internet 
applications etc. 

[0026] Similarly, the term "decoder* is used to apply to 
an integrated receiver/decoder for receiving and 
decrypting an encrypted transmission, the receiver and 

10 decoder elements of such a system as considered sep- 
arately, as well as to a receiver capable of receiving 
non-encrypted broadcasts. The term equally covers 
decoders including additional functions, such as web 
browsers, together with decoders integrated with other 

is devices, for example, integrated VHS/decoder devices, 
digital televisions, or the like. 

[0027] The term MPEG refers to the data transmission 
standards developed by the International Standards 
Organisation working group "Motion Pictures Expert 

20 Group" and notably the MPEG-2 standard developed for 
digital television applications and set out in the docu- 
ments ISO 13818-1, ISO 13818-2, ISO 13818-3, and 
ISO 13818-4. In the context of the present patent appli- 
cation, the term includes all variants, modifications or 

25 . developments of the basic MPEG formats applicable to 
the field of digital data transmission. 
[0028] There will now be described, by way of exam- 
ple only, a preferred embodiment of the present inven- 
tion, with reference to the attached figures, in which: 

30 

Figure 1 shows an overview of a digital television 
system; 

Figure 2 shows the elements of the- 
35 receiver/decoder of Figure 1 ; 

Figure 3 shows a block diagram of the computer 
system of the receiver/decoder; 

40 Figure 4 shows in layer form the image data proc- 
essed by the graphic processor of Figure 2; 

Figure 5 shows the operations carried out in mem- 
ory for picture data to be displayed in the MPEG 
45 layer of Figure 4; and 

Figure 6 shows the operations carried out in mem- 
ory for the partial display of picture data in the 
MPEG layer. 

so 

[0029] An overview of a digital television system 1 
according to the present invention is shown in Figure 1 . 
The invention includes a mostly conventional digital tel- 
evision system 2 that uses the known MPEG-2 com- 
55 pression system to transmit compressed digital signals. 
In more detail, MPEG-2 compressor 3 in a broadcast 
centre receives a digital signal stream (typically a 
stream of video signals). The compressor 3 is con- 
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nected to a multiplexer and scrambler 4 by linkage 5. 
[0030] The. multiplexer 4 receives a plurality of further 
input signals, assembles the transport stream and 
transmits compressed digital signals to a transmitter 6 
of the broadcast centre via linkage 7, which can of 
course take a wide variety of forms including telecom- 
munications links. The transmitter 6 transmits electro- 
magnetic signals via uplink 3 towards a satellite 
transponder g, where they are electronically processed 
and broadcast via notional downlink 10 to earth receiver 
1 2, conventionally in the form of a dish owned or rented 
by the end user. The signals received by receiver 12 are 
transmitted to an integrated receiver/decoder 13 owned 
or rented by the end user and connected to the end 
user's television set 14. The receiver/decoder .13 
decodes "the compressed MPEG-2 signal into a televi- 
sion signal tor the television set 14. 
[0031] Other transport channels for transmission of 
the data are of course possible, such as terrestrial 
broadcast, cable transmission, combined satellite/cable 
links, telephone networks etc. 

[0032] In a multichannel system, the multiplexer 4 
handles audio and video information received from a 
number of parallel sources and interacts with the trans- 
mitter 6 to broadcast the information along a corre- 
sponding number of channels. In addition to audiovisual 
information, messages or applications or any other sort 
of digital data may be introduced in some or all of these 
channels interlaced with the transmitted digital audio 
and video information. 

[0033] A conditional access system 1 5 is connected to 
the multiplexer 4 and the receiver/decoder 13, and is 
located partly in the broadcast centre and partly in the 
decoder. It enables the end user to access digital televi- 
sion broadcasts from one or more broadcast suppliers. 
-A smartcard, capable of deciphering messages relating 
to commercial offers (that is, one or several television 
programmes sold by the broadcast supplier), can be 
inserted into the receiver/decoder 13. Using the 
decoder 13 and smartcard, the end user may purchase 
commercial offers in either a subscription mode or a 
pay-per-view mode. 

[0034] As mentioned above, programmes transmitted 
by the system are scrambled at the multiplexer 4, the 
conditions and encryption keys applied to a given trans- 
mission being determined by the access control system 
15. Transmission of scrambled data in this way is welt 
known in the field of pay TV systems. Typically, scram- 
bled data is transmitted together with a control word for 
descrambling of the data, the control word itself being 
encrypted by a so-called exploitation key and transmit- 
ted in encrypted form. 

[0035] The scrambled data and encrypted control 
word are then received by the decoder 13 having 
access to an equivalent of the exploitation key stored on 
a smart card inserted in the decoder to decrypt the 
encrypted control word and thereafter descramble the 
transmitted data. A paid-up subscriber will receive, for 



example, in a broadcast monthly ECM (Entitlement 
Control Message) the exploitation key necessary to 
decrypt the encrypted control word so as to permit view- 
ing of the transmission. 

5 [0036] An interactive system 1 6, also connected to the 
multiplexer 4 and the receiver/decoder 13 and again 
located partly in the broadcast centre and partly in the 
decoder, enables the end user to interact with various 
applications via a modem hack channel 1 7. The modem 

10 back channel may also be used for communications 
used in the conditional access system 15. An interactive 
system may be used, for example, to enable the viewer 
to communicate immediately with the transmission cen- 
tre to demand authorisation to watch a particular event, 

is download an application etc. 

[0037] Referring to Figure 2, the elements of the 
receiver/decoder 1 3 or set-top box adapted to be used 
in the present invention will now be described. The ele- 
ments shown in this figure will be described in terms of 

20 functional blocks. 

[0038] The decoder 13 comprises a central processor 
20 including associated memory elements and adapted 
to receive input data from a serial interface 21 , a parallel 
interface 22, a modem 23 (connected to the modem 

25 back channel 1 7 of Fig 1 ), and switch contacts 24 on the 
front panel of the decoder. 

[0039] The decoder is additionally adapted to receive 
inputs from an infra-red remote control 25 via a control 
unit 26 and also possesses two smartcard readers 27, 

30 28 adapted to read bank or subscription smartcards 29, 
30 respectively. The subscription smartcard reader 28 
engages with an inserted subscription card 30 and with 
a conditional access unit 29 to supply the necessary 
control word to a demultiplexer/descrambler 30 to ena- 

35 ble the encrypted broadcast signal to be descrambled. 
The decoder also includes a conventional tuner 31 and 
demodulator 32 to receive and demodulate the satellite 
transmission before being filtered and demultiplexed by 
the unit 30. 

40 [0040] Processing of data within the decoder is gener- 
ally handled by the central processor 20. The software 
architecture of the central processor corresponds to a 
. virtual machine interacting via an interface layer with a 
lower level operating system implemented in the hard- 

45 ware components of the decoder. This will now be 
described with reference to Figure 3. 
[0041] For the purposes of this description, an appli- 
cation is a piece of computer code for controlling high 
level functions of the receiver/decoder 13. For example, 

50 when the end user positions the focus of a remote con- 
troller on a button object seen on the screen of the tele- 
vision set and presses a validation key, the instruction 
sequence associated with the button is run. 
[0042] An interactive application proposes menus and 

55 executes commands at the request of the end user and 
provides data related to the purpose of the application. 
Applications may be either resident applications, that is, 
stored in the ROM (or FLASH or other non-volatile 
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memory) of the receiver/decoder 13, or broadcast and 
downloaded into the RAM or FLASH memory of the 
receiver/decoder 13. 

[0043] Applications are stored in memory locations in 
the receiver/decoder 13 and represented as resource 
files. The resource files comprise graphic object 
description unit files, variables block unit files, instruc- 
tion sequence files, application files and data files. 
[0044] The receiver/decoder contains memory divided . 
into a RAM volume, a FLASH volume and a ROM vol- 
ume, but this physical organization is distinct from the 
logical organization. The memory may further be 
divided into memory volumes associated with the vari- 
ous interfaces. From one point of view, the memory can 
be regarded as part of the hardware; from another point 
of view, the memory can be regarded as supporting or 
containing the whole of the system shown apart from 
the hardware. 

[0045] Referring to Figure 3, the computer system can 
be regarded as centred on a run time engine 40 forming 
part of a virtual machine 41. This is coupled to applica- 
tions on one side (the "high lever side), and, on the 
other side (the "low level" side), via various intermediate 
logical units discussed below, to the receiver/decoder 
hardware 42. The receiver/decoder hardware can be 
regarded as including various ports corresponding to 
the functional blocks discussed in relation to Figure 2 
(the interface 26 for the handset 25. the MPEG stream 
interface 30, the serial interface 21 , the parallel interface 
22, the interfaces to the card readers 27, 28, and the 
interface 23 to the modemmed back channel 17). 
[0046] Various applications 43 are coupled to the vir- 
tual machine 41. Some of the more commonly used 
applications may be more or less permanently resident 
in the system, as indicated at 44, while others will be 
downloaded into the system, eg from the MPEG data 
stream or from other ports as required. 
- [0047] The virtual machine 41 includes, in addition to 
the run time engine 40, some resident library functions 
45 which include a toolbox 46. The library contains mis- 
cellaneous functions in C language used by the engine 
40. These include data manipulation such as compres- 
sion, expansion or comparison of data structures, line 
drawing, etc. The library 45 also includes information 
about device drivers 49 in the firmware of the 
receiver/decoder, such as hardware and software ver- 
sion numbers and available RAM space, and a function 
used when downloading a new device 47. Functions 
can be downloaded into the library and stored in FLASH 
or RAM memory. 

[0048] The run time engine 40 is coupled to a device 
manager 48 which is coupled to a set of devices 47 
which are coupled to device drivers 49 which are in turn 
coupled to the ports or interfaces. In broad terms, a 
device driver can be regarded as defining a logical inter- 
face, so that two different device drivers may be coupled 
to a common physical port. A device will normally be 
coupled to more than one device driver; if a device is 



coupled to a single device driver, the device will nor- 
mally be designed to incorporate the full functionality 
. required for communication, so that the need for a sep- 
arate device driver is obviated: Certain devices may 

5 communicate among themselves. 

[0049] . As will be described below, there are three 
forms of communication from the devices 47 up to the 
run time engine: by means of variables, buffers, and 
events which are passed to a set of event queues. 

10 [0050] Each function of the receiver/decoder is repre- 
sented as a device 47. Devices can be either local or 
remote. Local devices include smartcards, SCART con- 
nector signals, modems, serial and parallel interfaces, a 
MPEG video and audio player and an MPEG section 

is and table extractor. Remote devices executed in a 
remote location, differ from local devices in that a port 
and procedure must be defined by the system authority 
or designer, rather than by a device and device driver 
provided and designated by the receiver/decoder man- 

20 ufacturer. 

[0051] The run time engine 40 runs under the control 
of the microprocessor and a common application pro- 
gramming interface. They are installed in every 
receiver/decoder so that all receiver/decoders are iden- 

25 . tical from the application point of view. 

[0052] The_ engine 40 runs applications 43 on the 
receiver/decoder. It executes interactive applications 
and receives events from outside the receiver/decoder, 
displays graphics and text, calls devices for services 

30 and uses functions of the library 45 connected to the 
engine 40 for specific computation. 
[0053] The run time engine 40 is an executable code 
installed in each receiver/decoder, and includes an 
interpreter for interpreting and running applications. The 

35 engine is adaptable to any operating system, including 
- a single task operating system (such as MS-DOS). The 
engine is based on process sequencer units (which take 
various events such as a key press, to carry out various 
actions), and contains its own scheduler to manage 

40 event queues from the different hardware interfaces. It 
also handles the display of graphics and text. A process 
sequencer unit comprises a set of action -groups. Each 
event causes the process sequencer unit to move from 
its current action-group to another action-group in 

45 dependence on the character of the event, and to exe- 
cute the actions of the new action-group. 
[0054] The engine 40 comprises a code loader to load 
and download applications 43 into the receiver/decoder 
memory. Only the necessary code is loaded into the 

so RAM or FLASH memory, in order to ensure optimal use. 
The downloaded data is verified by an authentication 
mechanism to prevent any modification of an applica- 
tion 43 or the execution of any unauthorized application. 
The engine 40 further comprises a decompressor. As 

55 the application code (a form of intermediate code) is 
compressed for space saving and fast downloading 
from the MPEG stream or via a built-in receiver/decoder 
mode, the code must be decompressed before loading 
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it into the RAM. The engine 40 also comprises an inter- 
preter to interpret the application code to update various 
variable values and determine status changes, and an 
error checker. 

[0055] Before using the services of any device 47, a s 
program (such as an application instruction sequence) 
has to be declared as a "client", that is, a logical access- 
way to the device 47 or the device manager 48. The 
manager gives the client a client number which is 
referred to in all accesses to the device. A device 47 can 10 
have several clients, the number of clients for each 
device 47 being specified depending on the type of 
device. A client is introduced to the device 47 by a pro- 
cedure "Device: Open Channel". This procedure 
assigns a client number to the client. A client can be 75 
taken out of the device manager 48 client list by a pro- 
cedure Device: Close Channel". 
[0056] The access to devices 47 provided by the 
device manager 48 can be either synchronous or asyn- 
chronous. For synchronous access, a procedure 20 
"Device: Calls is used. This is a means of accessing 
data which is immediately available or a functionality 
which does not involve waiting for the desired response. 
For asynchronous access, a procedure "Device: I/O" is 
used. This is a means of accessing data which involves 25 
waiting for a response, for example scanning tuner fre- 
quencies to find a multiplex or getting back a table from 
the MPEG stream. When the requested result is availa- 
ble, an event is put in the queue of the engine to signal 
its arrival. A further procedure "Device: Event" provides 30 
a means of managing unexpected events. 
[0057] As noted above, the main loop of the run time 
engine is coupled to a variety of process sequencer 
units, and when the mainjoop encounters an appropri- 
ate event, control is temporarily transferred to one of the 35 
process sequencer units. 

[0058] Thus, it can be seen that the computer system 
implemented in the processor 20 provides a platform 
having considerable flexibility in enabling an application 
to communicate with a variety of devices. 40 
[0059] Returning to Figure 2, the processing of sound 
and image data by each of the associated processors 
will now be described in detail. In the case of received 
audio and video signals, the MPEG packets containing 
these signals will be demultiplexed and filtered so as to 45 
pass real time audio and video data in the form of a 
packetised elementary stream (PES) of audio and video 
data to dedicated audio and video processors or decod- 
ers 33, 34. The converted output from the audio proces- 
sor 33 passes to a preamplifier 35 and thereafter via the so 
audio output of the receiver/decoder. The converted 
output from the video processor 34 passes via a graphic 
processor 36 and PAUSE CAM encoder 37 to the video 
output of the receiver/decoder. The video processor 
may be of a conventional type, such as the ST 3520 A 55 
of SGS Thomson. 

[0060] The graphic processor 36 additionally receives 
graphic data for display (such as generated images etc) 



from the central processor 20 and combines this infor- 
mation with information received from the video proces- 
sor 34 to generate a screen display combining moving 
images together with overlaid text or other images. An 
example of a graphic processor adapted to carry out 
this sort of operation is the CL 9310 of C-CUBE. 
[0061] In the case of received teletext and/or subtitle 
data, the conversion of the real time PES data to gener- 
ate the appropriate images may also be handled by 
dedicated processors. However, in most conventional 
systems, this is handled by the general processor 20. 
[0062] In point of fact, many of functions associated 
with the elements such as the graphic processor 36, 
video decoder 34, central processor 20 etc. may be 
combined or divided out in a number of ways, e.g. to 
integrate the central and graphic processors to form a 
single processor means etc. 

[0063] Referring now to Figure 4, the functionality of 
the graphic processor 36 will now be described. As dis- 
cussed above, the graphic processor receives and proc- 
esses real time video data from the video decoder 34 
together with graphic data received from the general 
processor 20 in order to generate an overlaid screen 
display. 

[0064] As shown in Figure 4, the graphic processor 36 
is adapted to process input data divided into four distinct 
layers; a background layer 50, an MPEG layer 51, a 
graphic layer 52 and a cursor layer 53. As will be under- 
stood, the background layer 50 corresponds to the low- 
est layer of the screen display, the other layers being 
progressively superimposed with varying degrees of 
translucency or opacity over this layer. 
[0065] In the case where the decoder is configured to 
display a broadcast video signal, the background and 
MPEG layers 50, 51 correspond to the stream of data 
received from the video decoder 34, the layer 50 corre- 
sponding to MPEG still pictures received from the 
decoder 34 and the layer 51 corresponding to a moving 
video MPEG signal received from the decoder. The divi- 
sion of a video signal into a fixed and a changing part is 
a known characteristic of MPEG compression. 
[0066] Other configurations of the decoder are possi- 
ble, for example, where the background and MPEG lay- 
ers 50, 51 are completed by picture data in any number 
of formats received from the processor 20. For example, 
in the case where the decoder is acting in web browser 
configuration, the processor 20 may supply still and/or 
moving picture data to complete the layers 50, 51 . The 
layer 50 may equally correspond, for example, to a 
background colour and the layer 51 to one or more win- 
dows displayed over the background and containing, for 
example, information, moving icons or the like. The 
operation of the system in handling picture data will be 
discussed in more below with reference to Figures 5 
and 6. 

[0067] Still and moving image data from the back- 
ground and MPEG layers 50, 51 are mixed together by 
the graphic processor 36, as represented by the ele- 
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ment 54, and a combined output provided. Mixing of the 
MPEG layer information 51 over the background layer 
50 by the graphic processor may carried out using a so- 
called alpha blending factor to permit a greater or lesser 
degree of translucency of the pixels in the MPEG layer 
image. In the case of a moving video image received 
from the video decoder 34, the same blending factor is 
used for all pixels within the video sequence. In the case 
of picture data from the central processor 20, the value 
of the blending factor for the layer 51 may be different for 
different parts of the screen. 

[0068] The graphic layer 52 is used for texts, shapes, 
icons etc that will be displayed on the screen over the 
images taken from the layers 50, 51, for example, to 
permit display of a moving icon or the like generated by 
the processor 20 over a real-time video sequence taken 
from the video decoder 34. 

[0069] In a similar manner to the blending carried out 
for the layers 50, 51 , the element 55 carries out a blend- 
ing of the graphic layer 52 with the combined output of 
the layers 50, 51. Different regions within the graphic 
layer 52 may be assigned a different blending factor and 
a corresponding different level of translucency depend- 
ing on the characteristics of the data within each region. 
[0070] A final layer, the cursor layer, is shown at 53 
and represents an opaque cursor image, generated by 
hardware under control of the central processor 20 and 
superimposed over all the previous layers. As shown at 
56, this layer is combined with the summed output from 
the combination of all previous layers to generate a final 
combined output 57 sent to the encoder 37 for subse- 
quent display. Unlike the previous layers, the cursor 
presents a continuously opaque appearance and is 
superimposed over the combined layers without any 
blending. 

[0071] Referring to Figures 5 and 6, the operation of a 
device 47 of the kind shown in Figure 3 and adapted to 
decompress and display downloaded picture images in 
the MPEG. layer 51 will now be described. In the follow- 
ing description, the term picture is used to describe a 
compressed digital image. Typically, the sorts of picture 
formats used may include MPEG still picture, JPEG for- 
mat picture. PNG format picture, GIF format picture, etc. 
[0072] Whilst the following description will concentrate 
on the processing and display of a single picture, a 
sequence of still pictures may be displayed one after the 
other in order to generate a moving image sequence. 
[0073] Referring to Figure 5, downloaded compressed 
picture data 60, 61 , 62 is initially stored in a buffer sec- 
tion of the RAM memory of the decoder indicated at 63. 
This buffer memory may be of a type initialised and 
managed by a high level application 43 responsible for 
decoding and displaying images, or an area of memory 
handled by the device manager 48 shown in Figure 3. 
[0074] Each type of picture file or group of picture files 
includes a header indicating the picture file format (GIF, 
MPEG, etc.) as well as the information needed to 
decompress the picture file. For example, a GIF format 



file 62 comprising more than one picture has a global 
header describing the size of the overall area where the 
two decompressed images will be displayed and a spe- 
cific header for each picture describing its size and loca- 

5 tion coordinates within the overall area. 

[0075] Following downloading of a compressed pic- 
ture into the buffer section 63 of the memory, a decom- 
pression of the picture data will be effected by the 
device in response to a command 

io PICTURE_DECOMPRESS received from the applica- 
tion. The subsequently decompressed image data 63, 
64, 65 is stocked in a separate storage section of the 
RAM memory indicated at 66 and reserved for image 
data eventually to be displayed in the MPEG layer. Each 

75 decompressed image or image sequence is given an 
image identity reference Id1 , Id2, Id3 by the device, this 
ID value being supplied to the high level application and 
used for all subsequent operations to be carried out on 
this data. 

20 [0076] Unlike the compressed picture data temporarily 
held in the application buffer 63, the decompressed 
image data 63, 64, 65 may be held indefinitely in the 
storage memory 66 until such time as the application 
decides to delete the information. 

25 - [0077] The storage of decompressed image data in a 
distinct assigned memory area permits the data to be. 
manipulated in a number of ways prior to display. For 
example, a resizing of the image may be carried out, 
either by the device itself, the device manager or by a 

30 higher level application. Equally, the image may be 
duplicated in order to be displayed at a number of posi- 
tions on the screen. Conversion of colour data associ- 
ated the image, for example to compensate for 
limitations in the functionality of the graphic processor, 

35 may also be carried out on the image. 

[0078] Modified or unmodified data stored in the mem- 
ory 66 is passed, in response to a command 
PICTURE_DISPLAY from the application, into a sepa- 
rate RAM memory section 67 assigned for images to be 

40 displayed in the MPEG layer 51 (see Figure 2). The size 
of the display memory 67 corresponds to the screen 
area. As shown, the images Id1 and Id2 are displayed at 
68 and 69, whilst the image or sequence of images Id3 
is duplicated and displayed at the positions 70, 71. The 

45 information in the memory section 67 is fed to the 
graphic processor 36 in order to create the MPEG layer 
51 , as shown in Figure 2. 

[0079] In addition to the transfer of image information 
between the storage area 66 and display area 67, a see- 
so ond transfer may also be carried out to copy information 
held in the storage area 66 into a memory area (not 
shown) associated with the display of images in the 
background layer 40 of Figure 2. For example, a single 
image may be replicated and displayed a number of 
55 times in the background layer in order to cover the 
screen in a tiling manner. The information stored in the 
memory area associated with the background layer is 
accessed by the graphic processor in the same manner 
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as the MPEG display area 67. 

[0080] As will be understood, the memory sections 63, 
64, 65 do not need to physically correspond to uninter- 
rupted memory zones in a single RAM or other memory 
element. In particular, the memory area 63 may be 
divided between a number of buffers. Figure 6 shows 
the steps associated with the decompression of a file 80 
containing two compressed pictures 81 , 82 previously 
downloaded into four associated buffer elements or lists 
of buffers 83, 84, 85, 86. 

[0081 ] Each buffer list corresponds to the buffer areas 
in which a block of data has been downloaded from the 
MPEG stream. The buffer list itself may designate a 
number of separate buffer areas depending on availabil- 
ity as the information is downloaded. 
[0082] At step 87, the application sends a 

PICTURE_DECOMPRESS command 87 to start the 
decompression process. The device allocates a group 
image Id and starts read the buffers. Once the start of a 
picture is found at step 88, the device assigns an image 
Id and starts decompression of the image. At step 89, 
the end of the first buffer list is reached and the applica- 
tion sends a P ICTU RE_AD D_D ATA command at step 
90 to command the device to read the next buffer list in 
the series. 

[0083] At this point, only part of the image of the first 
picture 81 has been decompressed and stored in the 
memory storage area 66. The application may never- 
theless decide to immediately transfer the partial image 
to the display memory area 67. 
[0084] The decompression of the remaining part of 
the picture 81 then continues until the start of the next 
picture is found at 91. At this point, the whole of the first 
picture 81 has been decompressed and stored in the 
memory area 66. The application may then update the 
contents of the display memory area 67 by copying the 
complete image into the display area 67. In this way, the 
whole of the first picture 81 may be displayed before the 
second picture has been decompressed. 
[0085] At step 92; the device informs the application 
of the end of the second buffer list 84 and the applica- 
tion sends a second PICTURE_ADD_DATA command 
93 to start the reading of the next buffer list 85. The 
process is repeated at the end of the third buffer list 85 
and beginning of the fourth buffer list 86 by the steps 94, 
95. Again, each time the end of a buffer is reached at 
92, 94, the application may copy the data that has 
already been decompressed from the storage area 66 
into the display area 67. 

[0086] At step 96, the end of the file is reached and 
both the pictures 81, 82 have been decompressed and 
loaded into the storage memory 66. At this point, the 
device informs the application of the successful decom- 
pression of the whole file and the application again cop- 
ies the contents of the storage memory 66 into the 
display memory 67 to display the complete set of pic- 
tures. 



Claims 

1. A decoder for a digital audiovisual transmission 
system, the decoder comprising a processor 

5 means for decompressing and displaying com- 

pressed digital picture data and a memory means, 
characterised in that the memory means comprises 
a storage memory allocated to receive decom- 
pressed digital image data from the processor 

10 means and at least one display memory readable 
by the processor means prior to display, data being 
copied from the storage memory to the display 
memory for subsequent display. 

75 2. A decoder as claimed in claim 1 in which the digital 
image data copied from the storage memory into 
the display memory is modified or duplicated during 
the copying step. 

20 3. A decoder as claimed in claim 1 or 2 in which the 
processor means is adapted to process image data 
in the display memory as one layer amongst a plu- 
rality of layers superimposed one over the other 
when displayed. 

25 

_4. A decoder as claimed in claim 3 in which the proc- 
essor means is adapted to display the image data 
in the display memory in a layer normally used by 
the processor means to display broadcast audiovis- 
30 ual information. 

5. A decoder as claimed in any preceding claim in 
which the memory means comprises a second dis- 
play memory readable by the processor means and 
35 corresponding to a second layer of displayed image 
data, data being copied from the storage memory 
to the second display memory for subsequent dis- 
play in the second layer of image data. 

40 6. A decoder as claimed in claim 5 in which the digital 
image data copied from the storage memory to the 
second display memory is modified or duplicated 
during the copying step. 

45 7. A decoder as claimed in any preceding claim, in 
which partial image data is copied from the storage 
memory to a display memory so as to permit dis- 
play of part of an image. 

so 8. A decoder as claimed in any preceding claim, in 
which image data is copied from the storage mem- 
ory into a first or second display memory under 
control of a high level application running on the 
processor means. 

55 

9. A decoder as claimed in any preceding claim, in 
which compressed digital picture data is stored in a 
buffer memory means prior to decompression by 
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the processor means. 

1 0. A decoder as claimed in claim 9, in which the buffer 
means comprises a plurality of buffer memory ele- 
ments. 5 

11. A decoder as claimed in claim 10, in which the 
decompression and transfer of image data from the 
buffer memory elements to the storage memory, 
and from the storage memory to a display memory, 10 
is controlled by the processor means such that 
image information present in the storage memory is 
transferred to the display memory at the end of the 
decompression of the contents of each buffer ele- 
ment. 75 

12. A decoder as claimed in any preceding" claim, in 
which the decompression and transfer of a group of 
images in a single image file from the buffer mem- 
ory means to the storage memory, and from the 20 
storage memory to a display memory, is controlled 

by the processor means such that image informa- 
tion is transferred from the storage memory to the 
display memory at the end of the decompression of 
each image in the image file. 25 , 

13. A decoder as claimed in any preceding claim, in 
which the processor means is adapted to decom- 
press picture data sent in a compression standard 
that uses a colour look-up table. 30 

14. A decoder as claimed in any preceding claim, in 
which the processor means is adapted to decom- 
press picture data sent in a compression standard 
that uses a red/blue/green colour value associated 35 
with each pixel. 

15. A decoder as claimed in any preceding claim in 
which the processor means comprises a general 
processor for decompressing digital picture data 40 
and a graphic processor for preparing the decom- 
pressed data for display. 

16. A method of digital image processing in a decoder 

for a digital audiovisual transmission system, the 45 
decoder comprising a processor means for decom- 
pressing and displaying compressed digital picture 
data characterised in that decompressed digital 
image data from the processor means is transmit- 
ted to a storage memory and thereafter copied from so 
the storage memory to a display memory and read 
by the processor means for subsequent display. 
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